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Method of and scaling unit for scaling a three-dimensional model 



The invention relates to a method of scaling a three-dimensional input model 
in a three-dimensional input space into a three-dimensional output model which fits in a 
predetermined three-dimensional output space. 

The invention further relates to a scaling unit for scaling a three-dimensional 
5 input model in a three-dimensional input space into a three-dimensional output model which 
fits in a predetermined three-dimensional output space. 

The invention further relates to an image display apparatus comprising: 

- receiving means for receiving a signal representing a three-dimensional model; 

- a scaling unit as described above; and 

10 - rendering means for rendering a three-dimensional image on basis of the three- 
dimensional output model. 

The invention further each relates to a computer program product to be loaded 
by a computer arrangement, comprising instructions to scale a three-dimensional input model 
in a three-dimensional input space into a three-dimensional output model which fits in a 
1 5 predetermined three-dimensional output space. 

The probability that the size of a three-dimensional scene does not match with 
the display capabilities of an image display device, on which the scene is to be displayed, is 

20 high, e.g. the dimensions of a three-dimensional scene comprising a house are much bigger 
than typical dimensions of a display device. Hence, a scaling operation is required. Other 
reasons why scaling might be required is to adapt the geometry of the three-dimensional 
model representing the three-dimensional scene to a transmission channel or to adapt the 
three-dimensional model to the viewer's preferences. 

25 Linear scaling operations on a three-dimensional model representing a three- 

dimensional scene are well known. Scaling of depth information is in principle performed by 
means of a linear adaptation of the depth information related to the depth range of the output 
space. Alternatively, information which exceeds the limits of the display capabilities are 
clipped. 
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A disadvantage of depth adaptation or scaling is that it might result in 
reduction of depth impression. Especially the linear depth scaling might be disadvantageous 
for the depth impression of the scaled three-dimensional model because the available depth 
range of display devices is often relatively small. 



It is an object of the invention to provide a method of the kind described in the 
opening paragraph which results in a scaled three-dimensional output model with a relatively 
strong three-dimensional impression. 

10 This object of the invention is achieved in that a first input surface in the three- 

dimensional input space, having a first distance to a viewpoint, is projected to a first output 
surface in the predetermined three-dimensional output space by applying a first scaling factor 
and whereby a second input surface in the three-dimensional input space, having a second 
distance to the viewpoint, which is smaller than the first distance, is projected to a second 

1 5 output surface in the predetermined three-dimensional space, by applying a second scaling 
factor which is larger than the first scaling factor. In other words, the applied scaling factor is 
not constant but is related to the distance between an input surface and a viewpoint. A 
smaller distance means a larger scaling factor. An advantage of the method according to the 
invention is that the three-dimensional input model is adapted, i.e. reshaped, such that the 

20 depth impression is at least maintained or even enhanced. Notice that with a linear three- 
dimensional scaling, the depth impression is reduced if the depth range of the predetermined 
three-dimensional output space is much smaller than the depth of the three-dimensional input 
space. With the method according to the invention this reduction is prevented. Optionally the 
depth impression is even enhanced. 

25 In an embodiment of the method according to the invention, a first input data 

point of the three-dimensional input model, being located at the first input surface is 
projected to a first output data point of the three-dimensional output model, being located at 
the first output surface by means of a perspective projection relative to the viewpoint, and a 
second input data point of the three-dimensional input model, being located at the second 

30 input surface is projected to a second output data point of the three-dimensional output 

model, being located at the first output surface by means of a perspective projection relative 
to the viewpoint. In other words, the input data points are projected to respective data output 
points on basis of a single viewpoint. An advantage of this embodiment of the method 
according to the invention, is that the original depth impression of the input three- 
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dimensional model is maintained. That means that the original depth impression and the 
depth impression of the output three-dimensional model are substantially mutually equal. 

In another embodiment of the method according to the invention, a first input 
data point of the three-dimensional input model, being located at the first input surface is 
5 projected to a first output data point of the three-dimensional output model, being located at 
the first output surface by means of a perspective projection relative to the viewpoint, and a 
second input data point of the three-dimensional input model, being located at the second 
input surface is projected to a second output data point of the three-dimensional output 
model, being located at the first output surface by means of a perspective projection relative 

10 to a further viewpoint. In other words, the input data points are projected to respective data 
output points on basis of multiple viewpoints. An advantage of this embodiment of the 
method according to the invention, is that the original depth impression of the input three- 
dimensional model is enhanced. That means that the depth impression of the output three- 
dimensional model is even higher than the original depth impression of the input three- 

15 dimensional model. 

It is a further object of the invention to provide a scaling unit of the kind 
described in the opening paragraph which is arranged to provide a scaled three-dimensional 
output model with a relatively strong three-dimensional impression. 

This object of the invention is achieved in that the scaling unit comprises 

20 computing means for computing coordinates of output data points of the three-dimensional 
output model corresponding to respective input data points of the three-dimensional input 
model, whereby a first one of the input data points which is located at a first input surface in 
the three-dimensional input space, having a first distance to a viewpoint, is projected to a first 
one of the output data points which is located at a first output surface in the predetermined 

25 three-dimensional output space by applying a first scaling factor and whereby a second one 
of the input data points which is located at a second input surface in the three-dimensional 
input space, having a second distance to the viewpoint, which is smaller than the first 
distance, is projected to a second one of the output data points which is located at a second 
output surface in the predetermined three-dimensional space, by applying a second scaling 

30 factor which is larger than the first scaling factor. 

It is a further object of the invention to provide an image processing apparatus 
of the kind described in the opening paragraph which is arranged to provide a scaled three- 
dimensional output model with a relatively strong three-dimensional impression. 
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This object of the invention is achieved in that the scaling unit comprises 
computing means for computing coordinates of output data points of the three-dimensional 
output model corresponding to respective input data points of the three-dimensional input 
model, whereby a first one of the input data points which is located at a first input surface in 
5 the three-dimensional input space, having a first distance to a viewpoint, is projected to a first 
one of the output data points which is located at a first output surface in the predetermined 
three-dimensional output space by applying a first scaling factor and whereby a second one 
of the input data points which is located at a second input surface in the three-dimensional 
input space, having a second distance to the viewpoint, which is smaller than the first 

10 distance, is projected to a second one of the output data points which is located at a second 
output surface in the predetermined three-dimensional space, by applying a second scaling 
factor which is larger than the first scaling factor. 

It is a further object of the invention to provide a computer program product of 
the kind described in the opening paragraph which results in a scaled three-dimensional 

15 output model with a relatively strong three-dimensional impression. 

This object of the invention is achieved in the computer program product, after 
being loaded in a computer arrangement comprising processing means and a memory, 
provides said processing means with the capability to compute coordinates of output data 
points of the three-dimensional output model corresponding to respective input data points of 

20 the three-dimensional input model, whereby a first one of the input data points which is 

located at a first input surface in the three-dimensional input space, having a first distance to 
a viewpoint, is projected to a first one of the output data points which is located at a first 
output surface in the predetermined three-dimensional output space by applying a first 
scaling factor and whereby a second one of the input data points which is located at a second 

25 input surface in the three-dimensional input space, having a second distance to the viewpoint, 
which is smaller than the first distance, is projected to a second one of the output data points 
which is located at a second output surface in the predetermined three-dimensional space, by 
applying a second scaling factor which is larger than the first scaling factor. 

Modifications of the scaling unit and variations thereof may correspond to 

30 modifications and variations thereof of the image processing apparatus, the method and the 
computer program product, being described. 
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These and other aspects of the method, of the scaling unit, of the image 
processing apparatus, and of the computer program product according to the invention will 
become apparent from and will be elucidated with respect to the implementations and 
embodiments described hereinafter and with reference to the accompanying drawings, 
5 wherein: 

Fig. 1 schematically shows a method of scaling according to the prior art; 

Fig. 2A schematically shows a first embodiment of the method of scaling 
according to the invention; 

Fig. 2B schematically shows a second embodiment of the method of scaling 
1 0 according to the invention; 

Fig. 3 schematically shows the mapping of input data points into data elements 
of a memory device; and 

Fig. 4 schematically shows an image processing apparatus according to the 

invention. 



There are several types of models for the storage of three-dimensional 
information, i.e. a three-dimensional model: 

- Wireframes, e.g. as specified for VRML. These models comprise a structure of lines and 
20 faces. 

- Volumetric data-structures or voxel maps (Voxel means volume element). These 
volumetric data-structures comprise a three-dimensional array of elements. Each element 
has three dimensions and represents a value of a property. E.g. CT (Computer 
tomography) data is stored as a volumetric data-structure in which each element 

25 corresponds to a respective Hounsfield value (unit to express the amount of X-ray 

absorption). 

- Two-dimensional image with depth map, e.g. a two-dimensional image with RGBZ 
values. This means that each pixel comprises three color component values and a depth 
value. The three color component values also represent a luminance value. 

30 - Image based models, e.g. stereo image pairs or multiview images. These types of images 
are also called light fields. 

Conversions of data represented by one type of three-dimensional model into 
another three-dimensional model is possible. E.g. data represented with a wireframe or a two- 
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dimensional image with depth map can be converted by means of rendering into data 
represented with a volumetric data-structure or image based model. 

The amount of depth which can be realized with a three-dimensional display 
device depends on its type. With a volumetric display device the amount of depth is fully 
5 determined by the dimensions of the display device. Stereo displays with e.g. glasses have a 
soft limit for the amount of depth which depends on the observer. Observers might become 
fatigued if the amount of depth is too much caused by a "conflict" between lens 
accommodation and mutual eye convergence. Autostereoscopic display devices, e.g. based 
on an LCD with a lenticular screen for multiple views, have a theoretical maximum depth- 

1 0 range which is determined by the amount of views. 

Fig. 1 schematically shows a method of linear scaling according to the prior 
art. Fig. 1 shows a three-dimensional input model 100 and a linear scaled three-dimensional 
output model 102 which fits in a predetermined three-dimensional output space 104, e.g. 
corresponding to the viewing range of a three-dimensional display device. The scaling means 

1 5 that each of the input data points /, , I 2 , 7 3 and I A is transformed to a respective one of the 

output data points O l9 0 2 , 0 3 and 0 4 . E.g. in Fig. 1 is depicted that input data point I x , which 
is located on the first input surface 106 at the border of the three-dimensional input model 
100, is mapped to output data point O x , which is located on the first output surface 1 10 at the 
border of the predetermined three-dimensional output space 104. In Fig. 1 is also depicted 
20 that input data point 7 3 , which is located at the second input surface 108 at an other border of 
the three-dimensional input model 100, is mapped to output data point 0 3 , which is located 

at the second output surface 1 12 at the other border of the predetermined three-dimensional 
output space 104. Both the three-dimensional input model 100 and the three-dimensional 
output model 102 have a block shape. E.g. the width W f (z3) of a first side, located at the first 
25 input surface 106 (z = z3 ) of the three-dimensional input model 100 is equal to the width 
W t {z2) of a second side, located at the second input surface 108 ( z = z2 ) of the three- 
dimensional input model 100 and the width W 0 (z4)of a first side ( z = z4 ), located at the first 
output surface 1 10 of the three-dimensional output model 102 is equal to the width W a (z\) of 

a second side ( z = zl ), located at the second output surface 1 12 of the three-dimensional 
30 output model 102. 

Fig. 2A schematically shows the method of scaling according to the invention. 
Fig. 2A shows a three-dimensional input model 100 and a three-dimensional output model 
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200 scaled in perspective of a single viewpoint V l . Although the three-dimensional input 
model 100 has a rectangular shape, the three-dimensional output model 200 has a trapezoid 
shape. E.g. the first width ^(z3) of the first side (z = z3 ) of the three-dimensional input 
model 100 is equal to the second width W { (z2) of the second side (z = z2 ) of the three- 
5 dimensional input model 100 but the first width J^(z4)of the first side (z = z4 ) of the three- 
dimensional output model 200 is different from the second width JV 0 (z\)of the second side 

of the three-dimensional output model 200. In other words, the change of the first width 
and second width J^(z2) of the three-dimensional input model 100 into the first 

width JV 0 (z4) and second width W a (z\) 9 respectively, depends on the location of the 
10 different sides of the three-dimensional input model 100, i.e. the z-coordinates. 

The scaling, i.e. transformation of the three-dimensional input model 100 into 
the predetermined three-dimensional output space 104 is such that each of the output data 
points O l , 0 2 , 0 3 and 0 4 is disposed at or located very close to (depending on the accuracy of 

computation) respective lines from the respective input data points /, , I 2 , 1 3 and I 4 to a single 
15 viewpoint V x . E.g. a first one 0 3 of the output data points is located on a first line /, from the 
first input data point 7 3 to the viewpoint V x and also a second one 0 2 of the output data 
points is located on a second line l 2 from the second input data point I 2 to the particular 
viewpoint V x . 

As said above, the scaling according to the invention is a kind of perspective 
20 projection resulting in a deformation of the three-dimensional input model. Below some 

computations are provided to show the extent of the deformation. The extent of deformation 
is related to the difference in the change of a first side and the change of a second side. 

The first width W 0 (z4) = \0 2 - O x \ of the first side of the three-dimensional 

output model 200 in which the output data points O x and 0 2 are located, can be computed 
25 with Equation 1 : 

^(*4) = ^^(zl+</), (1) 
z3 

with Wf(z3) = ||/ 2 - 7,|| the first width of the first side of the three-dimensional input model 
100, in which the input data points /, and J 2 are located, zl the z-coordinate of the border of 
the predetermined three-dimensional output space 104, z3 the z-coordinate of the first 
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surface of the three-dimensional input model 100 and d the depth, i.e. z-range of the 
predetermined three-dimensional output space 104. 

The second width W u (z\) = \\o 4 - 0,|| of the second side of the three- 
dimensional output model 200 in which the output data points 0 3 and 0 4 are located, can be 
5 computed with Equation 2: 

^(zi) = ^Ipzl, (2) 

with W f (z2) = ||/ 4 - / 3 | the second width of the second side of the three-dimensional input 
model 100 in which the input data points I y and 7 4 are located and z2 the z-coordinate of the 
second side of the three-dimensional input model 100. 
10 The difference in size between the two output sides can be computed with 

Equation 3. 

D = W 0 (z\)- W 0 (z4) = V&P-zl - ^f^(zl + d) (3) 

z2 z3 

The relative difference between the two output sides corresponds with the difference in 
scaling factors being applied for the different sides, i.e. surfaces. See Equation 4. 
15 ^(,l)-^ 4) 

rel W{z\) V ' 

In Table 1 some examples are listed. Example 1. Suppose the three- 
dimensional model 100 corresponds to a scene, e.g. a room of 5m*5m*10m, i.e. W.(z2)- 

5m, WXz3) = 5m and z3- z2= 5m. The predetermined three-dimensional output space 104 

corresponds to a volumetric display device with a depth range of 10cm, i.e. d =0.10m. The 

20 distance between the viewpoint V x , where the observer 106 is located, and the volumetric 

display device is equal to 2 m, i.e. zl=2m. Then the first width W 0 (z4)of the first side of the 
scaled three-dimensional output model 200 is equal to 0.7m and the second width ^(zl) of 
the second side of the scaled three-dimensional output model 200 is equal to lm. Hence, the 
difference between the two output sides is equal to 0.3m and the difference in scaling factors 

25 is 30%. 

Example 2. Most of the values of Example 1 are applicable. However now the 
three-dimensional model 100 corresponds to a long corridor of 5m*20m. Then the first width 
W Q {zA)of the first side of the scaled three-dimensional output model 200 is equal to 0.35m 
while the second width W 0 {z\)oi the second side of the scaled three-dimensional output 
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model 200 is still equal to lm. Hence, the difference between the two output sides is equal to 
0.65m and the difference in scaling factors is 65%. 

Example 3 . At z = z3 a first actor is located having a width W i (z3) of 0.5m and 
at z = z2 a second actor is located having a width W^zl) of 0.5m. The distance between the 
5 two actors is 1 m, i.e. z3 - z2 =1 . The representation of the first actor is scaled to the first 
output surface 1 10 of the scaled three-dimensional output model 200. The width W 0 (z4) 
which is equal to 0.1m The representation of the second actor is scaled to the second output 
surface 112. The width W Q (zX) is equal to 0.095m. Hence, the difference between the two 
output sides is equal to 0.005m and the difference in scaling factors is 5%. 

10 Example 4. Most of the values of Example 3 are applicable. However, now the 

predetermined three-dimensional output space 104 corresponds to a volumetric display 
device with a depth range of 5cm, i.e. d =0.05m. Hence, the difference between the two 
output sides is equal to 0.007m and the difference in scaling factors is 7%. 

Example 5. Most of the values of Example 3 are applicable. However, now the 

15 predetermined three-dimensional output space 104 corresponds to a volumetric display 
device with a depth range of 5cm, i.e. d =0.02m. Hence, the difference between the two 
output sides is equal to 0.008m and the difference in scaling factors is 8%. 

Table I. Examples of scaling. 

Example ^(^) W t (z3) zl z2 z3 d W 0 {z\) W Q {zA) D D rei [%] 



1 


5 


5 


2 


10 150.10 


1 


0.7 0.3 


30 


2 


5 


5 


2 


10 300.10 


1 


0.35 0.65 


65 


3 


0.5- 


0.5 


2 


10 110.10 


0.100 


0.0950.005 


5 


4 


0.5 


0.5 


2 


10 1 1 0.05 


0.100 


0.093 0.007 


7 


5 


0.5 


0.5 


2 


10 1 1 0.02 


0.100 


0.0920.008 


8 



20 

Fig. 2B schematically shows a second embodiment of the method of scaling 
according to the invention. In this embodiment there is not a single viewpoint but there is a 
range of viewpoints V x , V 2 . The scaling, i.e. transformation of the three-dimensional input 
model 100 into the predetermined three-dimensional output space 104 is such that each of the 
25 output data points O x , 0 2 , 0 3 and 0 4 is disposed at or located very close to (depending on the 
accuracy of computation) respective lines from the respective input data points 
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/, , I 2 , / 3 and / 4 to a range of viewpoints V l , F 2 . E.g. a first one 0 3 of the output data points 
is located on a first line /, from the first input data point I 3 to the viewpoint V } but a second 
one 0 2 of the output data points is located on a second line l 2 from the second input data 
point I 2 to the another viewpoint V 2 . Preferably, each of the input surfaces of the three- 
5 dimensional input model is projected into a corresponding output surface of the three- 
dimensional output model on basis of its own viewpoint. When comparing the three- 
dimensional output model 202 as depicted in Fig. 2B with the three-dimensional output 
model 200 as depicted in Fig. 2A, it can be observed that the deformation of the three- 
dimensional input model 100 is more in the embodiment of the method according to the 
10 invention as described in connection with Fig. 2B than in the embodiment of the method 
according to the invention as described in connection with Fig. 2A. Notice that 
Wq(z4) < W 0 (z4) . The extent of the additional deformation is related to the amount of 

enhancement of the depth impression. 

It will be clear that instead of enhancement of the depth impression, as 
15 described in connection with Fig. 2B also a limited reduction of depth impression can be 

achieved by applying multiple viewpoints, e.g. one viewpoint behind or above the other. This 
is not depicted. 

Fig. 3 schematically shows the mapping of input data points /, -/„ into data 
cells 304-320 of a memory device 302. The memory device 302 comprises a three- 

20 dimensional data structure. This three-dimensional data structure represents the 

predetermined three-dimensional output space. From the three-dimensional data structure 
only one z 9 x -slice, i.e. y -coordinate is constant, is depicted in Fig. 3. The different y,x- 
slices 330-340, i.e. z -coordinate constant, might correspond to the different viewing planes 
of a volumetric display device. The values, e.g. color and luminance, of the different output 

25 data points O, - 0 13 are stored in the respective data cells 304-320 of the memory device 302. 

For each input data point the corresponding data cell is determined and filled with the 

appropriate color and luminance value. E.g. input data point /, is mapped into output data 
point 0, and stored into data cell 312 and input data point / 6 is mapped into output data 
point (9 6 and stored into data cell 304. The mapping from input data points to output data 
30 points is based on the known coordinates of the input data points, the predetermined three- 
dimensional output space and the viewpoint V x . The x , y and z coordinates of the output data 
points can be determined with Equation 5,6 and 7, respectively. 
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= /,(/,(*,**)) (5) 
0,M -/,(/,(*■**)> (6) 

0,W = /.(/,te^*)) (7) 
In this case, the z -coordinates of the output data points O t - 0 6 are computed as follows. It is 
5 known, that there are six input data points /, - 1 6 located on one line /, , through the viewpoint 
V x . The z -coordinate of the first output surface, which is located at a border of the 
predetermined three-dimensional output space is known a priori. The z -coordinate of the 
first output data point O x on the line /, is set to this known z -coordinate. The z -coordinate 
of the second output surface, which is located at the other border of the predetermined three- 
10 dimensional output space is known a priori. The z -coordinate of the last output data point 
0 6 on the line /, is set to this latter z -coordinate. The other z -« ■ 

dividing the z -range of the predetermined three-dimensional output space into five 
equidistant distances. It should be noted that alternative mappings are possible, see e.g. 
below. A prerequisite is that the order of input data points is not changed. 
1 5 Alternatively, the values of output data points 0 1 - O {0 are computed on basis of 

distances between input data points I 7 -I l0 . In this case, the z -coordinates of the output data 

points O 7 -O l0 are computed as follows. It is known, that there are four input data points 7 7 - 

J t0 located on one line / 2 , through the viewpoint V x . The z -coordinate of the first output 

surface, which is located at a border of the predetermined three-dimensional output space is 

20 known a priory. The z -coordinate of the first output data point 0 7 on the line l 2 is set to this 
known z -coordinate. The z -coordinate of the second output surface, which is located at the 
other border of the predetermined three-dimensional output space is also known a priori. The 
z -coordinate of the last output data point O ]0 on the line l 2 is set to this latter z -coordinate. 
The z -coordinates output data points 0 9 and 0 9 are computed on basis of distances between 

25 input data points I 7 - / I0 and the distance between the first output surface and the second 
output surface. Optionally, further values of output data points O n -O n are computed on 
basis of interpolation of multiple input data points, e.g. I 7 - / I0 . 

In a further alternative, the value of a particular output data point O l3 is 
computed on basis of other output data points, e.g. because the corresponding input data 

30 point belongs to an object in the three-dimensional input model. In Fig. 3 it is depicted 
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that the three input data points 7 5 , I 9 and are on one line / 4 , indicating that they belong to 
one object. The particular input data point is located on the line / 3 through the viewpoint 
V x . Because there are no other input data points on the line / 3 , it is arbitrary in which data 
cell, i.e. to which z -coordinate the output data point O n is mapped. It might be stored in the 
5 data cell of a first y,x -slice 330 corresponding to the first surface of the three-dimensional 
output model or in a last y,x -slice 340 corresponding to the second surface of the three- 
dimensional output model. An other option is depicted in Fig. 3. The Z -coordinate of the 
output data point 0 I3 is based on the Z -coordinates of the output data points 0 5 and 0 9 . 

It should be noted that the storage scheme as described above is just an 

10 example. Alternatively, the three-dimensional output model is not stored in such a rigid 

three-dimensional data structure having fixed planes, i.e. y,x -slice 330. An option is to store 
from each output data point not only a luminance and/or color value but also its coordinates. 

Fig. 4 schematically shows an image processing apparatus 400 according to 
the invention. The image processing apparatus 400 comprises: 

15 - a receiving unit 402 for receiving a signal representing a three-dimensional input model; 

- a scaling unit 404 for scaling the three-dimensional input model into a three-dimensional 
output model; and 

- rendering means 405 for rendering a three-dimensional image on basis of the three- 
dimensional output model. 

20 The signal is provided at the input connector 4 1 0. The signal e.g. is a digital 

stream of data which is according to the VRML specification. The signal may be a broadcast 
signal received via an antenna or cable but may also be a signal from a storage device like a 
VCR (Video Cassette Recorder) or Digital Versatile Disk (DVD). 

The scaling unit 404 comprises computing means 407 for computing 

25 coordinates of output data points of the three-dimensional output model corresponding to 
respective input data points of the three-dimensional input model, whereby a first one of the 
input data points which is located at a first input surface in the three-dimensional input space, 
having a first distance to a viewpoint, is projected to a first one of the output data points 
which is located at a first output surface in the predetermined three-dimensional output space 

30 by applying a first scaling factor and whereby a second one of the input data points which is 
located at a second input surface in the three-dimensional input space, having a second 
distance to the viewpoint, which is smaller than the first distance, is projected to a second one 
of the output data points which is located at a second output surface in the predetermined 
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three-dimensional space, by applying a second scaling factor which is larger than the first 
scaling factor. The computation of coordinates of output data points is as described in 
connection with Fig. 2A, Fig. 2B and Fig. 3. 

The computing means 407 of the scaling unit 404 and the rendering means 405 
5 may be implemented using one processor. This is not depicted as such. Normally, these 
functions are performed under control of a software program product. During execution, 
normally the software program product is loaded into a memory, like a RAM, and executed 
from there. The program may be loaded from a background memory, like a ROM, hard disk, 
or magnetically and/or optical storage, or may be loaded via a network like Internet. 

10 Optionally an application specific integrated circuit provides the disclosed functionality. 

The image processing apparatus optionally comprises a display device 406 for 
displaying the output images of the rendering means. The image processing apparatus 400 
might e.g. be a TV. Alternatively the image processing apparatus 400 does not comprise the 
optional display device but provides the output images to an apparatus that does comprise a 

1 5 display device 406. Then the image processing apparatus 400 might be a set top box, a 

satellite-tuner, a VCR player, a DVD player or recorder and the like. Optionally the image 
processing apparatus 400 comprises storage means, like a hard-disk or means for storage on 
removable media, e.g. optical disks. The image processing apparatus 400 might also be a 
system being applied by a film-studio or broadcaster. An other option is that the image 

20 processing apparatus 400 is comprised in a game device, for playing games. 

It should be noted that the viewpoints which are used to project the input data 
points to the output data points, do not necessarily have to match with an actual position of an 
observer. Besides that, the viewpoints which are used to project the input data points to the 
output data points do not necessarily have to match with another viewpoint which is used to 

25 render a three-dimensional image. That means data the different viewpoints should be 

interpreted as central points for projection. These viewpoints define the geometrical relation 
between input data points and output data points. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention and that those skilled in the art will be able to design alternative 

30 embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be constructed as limiting the claim. 
The word 'comprising' does not exclude the presence of elements or steps not listed in a 
claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
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comprising several distinct elements and by means of a suitable programmed computer. In 
the unit claims enumerating several means, several of these means can be embodied by one 
and the same item of hardware. The usage of the words first, second and third, etcetera do not 
indicate any ordering. These words are to be interpreted as names. 



